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Abstract: 

PROBLEM TO BE SOLVED: To automatically generate a panorama image from photographed 
continuous images by deciding width of slit images respectively, performing cutout and connection of 
slit images and producing panorama images for a right eye and a left eye. SOLUTION: This method 
calculates optical flow between the n-th reference frame image and the (n+l)th comparison frame 
image, performs cutout from the reference frame image in a slit shape based on the dimension of the 
optical flow and generates a slit image. The slit image which is cut out from the n-th reference frame 
image is connected to an image which combines up to the (n+l)th slit images and a new panorama 
image is generated. Although a position where the slit images are connected changes according to the 
turning direction of a video camera 200, because the camera 200 is turned to the left when the code of 
a horizontal component of central line optical flow is positive, the slit image is connected to the left 
against a panorama image to produce a new panorama image. COPYRIGHT: (C)1999,IPO 
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-:>m¥m<D^*>. «J^fc>3:Sii^^2^-tl.t't 

[w*«2] *^ucMaAV7vB<si*ifca^§n 

ri':tBf««^^:^ra. 

[11*113] ^^\^fM.)-^j'7^mmwicfh^. 

KrlBt&ji^$-[lIKI4tLT|friB»?fl=llll«Or-^' 
t^-^v^T, MBAV9vB^i5:IIliigS-tJ:l.::t^#iS 
t f & 2 l5m<J0 AV 7 vx T P J}-B«4fi^S:^ 

BiriBS^I.2o<7)«^Bmod*>. «jPi:^-I.B«Sr 

-^V^T, 1?fa^@ffl&lJffeBfll(7)AV9'7fflfil5r*B&r 

mix ij y hmm<Dmmm9s^mi,zm'^\^x. una 

i: ^ SB®jE)> «^ BulB^BfflJtt^XSfflwAy 7 vB 

Ma^ gffi&l^t afflcOAV 7 vB® Ir^^-f & fzibco 
mm BMRX/tE afflcOAV y^mm -?-fL-ftL^§ 



BirlEAV 7 vB^IS-^^^-^l. i i: 3 y f i-^' 
I. AV 7 V X r n 7 A I: laJIS 

L/v:iaifeii«=, 

[000 1] 

-:^±x-^^ixm:thx d^TAv^-^fflmiOifejyi 

i^^t^^-^-S AV 7 vxr ^^B«^^*:^tM 
[0002] 

;l';*;<5t-ta»L^B«{c2o(0S«X'J h 
::i{cJ:-5-C. 2^<7);^^7-C1i»$nfv:J:p^Hffi$ 

TV^I., Mtii rOinni-Oirectional Stereo j IEEE Tra 
nsaction On Pattern Analysis And Machine Intel lige 
nee, vol. I4.N0.2, February 1992 ^^a«5S^^?V^i)*,^0 

}^i^mXdl>z/};<yim.L. mmxr-yrio. 4 
S{Cil^LT«5^-rSt)WJ)l. (^icTJii^. Ijg36 

ojtt-9 0 oi^<7)mmm(>tiizbit^h > . at^s 

n^:B®i7)*'M>'^£*{-ftl-fixl 0 0 h-^-t/umi 
t:U^X\ i|i*Jltr^'-b;Pt'«§*5Slf^§a/iffi««oS 
S (C:C:X-li2 5 6tJ'-b;U-i:t'S.) <^x>J-y hHm?: 
^3J 0 ai-r, ^ U-C:£^«-9 0 Ot^cox V -y \-miik^±X 
^•^tTg*^WJ39 0 0 X 2 5 6 t^-b;l'C0/V7VB 
^ i2 ISc^tl . ^ Lt ^ 50 2 feiOV NV 7 vBtSI**^, 
AV^vB#l*ltieiliSixTVi^!|ffii[^ d-lT-tiSlt 

[0003] 

[I6W»^LJ; 0 fc ttmrn] mt. h'T^i-;!?;^ ^ 1 
^tHfX\ 2 ff ^ yX'^ Lfc J: -p ^Stav 7 
vB#^^-rs*SttT{d:, ±Mo:S:M{cSLyi<fc 
^(chT'^;i^^7t'Sl^tJtH«(cJtt. 3c*2o<:0X 

[0 0 04] U»L. i<^J:5^:^STAV7VBtfe$: 
* <0 0 ai-f X y -y b m^-^X'$) htz^. 
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[ 0 0 0 5 ] ^c:t\ h'T:t*;'< 'ym^crtn'sm.^zm^ 
nv 7 viifi||*ic0>lff^tj i -CcoSE^t^a^ Vifc X r V- 

[00061 

<^^mmzm^^y'y-<^)vyvi-<^±t^i%^-f 

^ ? JWai-tl. . m^cOk 0 t^S^cOX U >y Y-mX\±^j: 

< . nsb Vfz^mm<7):^rr- < favy u-<r>±% % 

mxu -y bHifecOjiSr^ix-^'frfe^^S, X'J -y 
fflZi.^XS^ffl^0''^V5vfflmS:^•t"^it^6<7)X'J -y h 

[0007] t.tz. Wmz\^hnjy'^7.=f\yi(m^ 

^^^mmt. ''NV7-7B^sr^-t5i^(c. 
'm.^<n'f-^\,zm^\^x^ nj^-^m^^. 



fC. 7^T\^-^%'kfh^<r>f^Jy~^mM^<ni^mAzn 

\.x<r>mmmm.ifi''^t:>ixh , 

[00 08] tfz. *^Bj5tc^SyNV5-7XTL'^Bfil 

ocOsM^B^I&itK^-a-. a^t-S2-:>oSI^B^I^ 

J^sS^-t^r. xy-y hBISI<7)1sRt/^^{c«o'v%T. m 
ffl^ilXSgfflc^y V7-7B{fe^4*K'tl.Jt*t>OX'J -y h 

^^^^•t!--?. c: 1 5r n y tr jl-^- (cffi^^l, ra/^ A 

tsfflcoAv^vB^&u^^afflio^v^-? 

BftS:{M-tS/tJ^){ciS<tW>:. m$t^j:mmi2 

mti'^'iMi't^^mzht 2*(^ai»iii±c7)#B 

mmmrT^:^f]^yx3-cr)±^^i,zm'^\>^x. 

mm^^ii-^ii^^^^l, xy -y hfflfii<?)liau^» 
Spil8C»-:JV^T. «ipt^&B«*^^*ifflSt;f:feSffl 
«0AV7VB«5-^fig-ri.!ti^)fiOxy >y hjBfifeSr-?-it-f 

fi!4tl>!ty)«0Xy -y hH^Sr-etimJS-^L, ^SfflS 
l/Safflt^AV 9 vBm$-^-ix-P*i.4J!g§€l. . 
[0009] 

[wncommcnmm] mmmi . mnp^wM(o^'i- 
commmmizm'^'<yy'7mm^ijm^^'ri>fz 
^co9m^^-ty^~^^-vxh&, HtcfeviT, s 

1 0 nmHiE.fmim^^Xhmt:t¥tAz:^?<yi 

mm^-^xm^tLfzmmsdM-tmimmim.xh 
h, sio2mm^tirzm^(^yu-Mmmi:A:f]^ 
m^t?>yu-j>.mmx-)j^m.Th^. si 031^71/ 

-ABm** 1 y U~J^ Ei)^b' 0 ^^SrflBT-tSfJ^at" 
hh, SI 04<i5ifg-t2.2'5C7)B«$:itl2L. rt^r 

^ii)vyx3~^n^-fhi^rT^ii)vyu-nnmx' 
hh. s\05<,i:^r7-<^)Vyn-<r>±t^\zmtfz 
X y -y bBm^ «j •) ffi-rx y «y bB«w 0 ai tmrsi 

I.. S 1 0 6Jixy -y hB{IKS:. J§^H^i:*S^LT*r 

u^ig-^B^ (>^v9-?B^a) ^4js-rsxy-yhBm 
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s 1 0 8^±>'^v^va^fe^^a^$tLT^^s^^f^^!!) (^t-/ 
-i^iuy^p^-t^mfmmnmmTh^. si 
^^iaaTS)^. s 1 1 oii^Tmj^mx'hi. 
lII^Ktt{4*¥ffi^w^:^t•csil:^:^l.*^ mmbuz 

V^. Wi.tt'Il|i|6faiS'7j<¥(cLT. i^:^l*Jt:llI!|B$-*Tt 
^4j£-ri.;«^{i, 1 8 OJSSJST-J: < . i^^Stt^E 
PITH. ZWS-7j<^:^ri6ltIeieT#Sj:3t^gL. H 
TmtMni'3 (:£|M]0) fclEilfc^-^T. IS^^^^nV 

[00 11] m2ii.:^wM(omi<^mmmmizg^?>^'^ 

fiit**^ SrJi^-f I. t'r^;^ ^vXhh. 2 0 1 (4 
h-T^;*^7 2 0 0WlIie!ttS:llSL. 3 6 0^1116$ 
1i:«.C:t*<^tg'5rHllT^5'S. 2 0 2{i:t'f^/{r;'<7 2 

A:^i1-|.!ti6cot:T*A:'3^S'C'S.I. . 2 o 3{±-^W 
y -^;^r^ y t a- ^-^ V- Xx- x 3 y^tfoa 
ytfi-:?-!:'^^, ayhrj.-:?2 0 3(4. Elc7)B# 

^^^i!iJi?riii^tff -J^yia^st^rs C PU 2 0 
4. CPU2 0 43!iJJ!!S5:4f-5M«-r-:5'^2:-B*W(c: 
ieittS^^U20 5. :t'^U-^'«|g^^S:CPU2 

0 4 (CfSS^i.^vTifcO^-ii^-b' 2 0 65,l^V'>X2 0 

^20 sstxr 2 0 9 . MM^^taiil-'S^cAb 

CO -iKieii^S 210fcJ;']i!'=3r<fct li)S?ixS . 2 

1 Uia>-tri-^'2 0 3c7)T-<X7V'f 2 0 8i:jil6 

;!?>T*>S, 2 1 2\im^^-y^"/9-Ml^2 1 1 fcr 
xrL'-^ 2 0 8**«S^-tl.Bflli:(7)|iii3S; t l.;t>bco 

[0012] lilT, 0iat>'02(ca-:JV^T^V9-7B 

«&ig:^<7)pmii#coSiBj^ff a . hp2 o i tfc 

■fSiptdbTJJ-;!!?^^ 2 0 02:11^ l:fr[eI^^llflI 
•S.JrdtfgSt^. ^rTb-r^;&;<^2 0 0& 

L s i n ^= e 



^\z.\.xm-nm,zwk'^thXo\,z\^x%>)(.\\ ttz. 
lslteft{4^:^^fi<0AV 7vBmtr4j«-ti.J«-^{±3 6 o 
g ( iniic^) i^'St^s*^ niTco^iOJ-^y^-^m^ 
i^mtt^izii. 1 8 oj^jsmiiBT'^ fitfj: i> 

V\ S^>tcHJHI2 0l£7)f(;i50tei!)-ClHiefl.J:a'5r 
S^SrfOffl LT fT*;&>{ 7 2 0 0 ^mig^-ti-T J: 
Vv. ® 1 tO||*fi<?)Jg.^-e(4. t'T^;!?X72 0 0S-7k^ 
t[lIi|gT-#SJ:otHP2 0 1&tSSL. h'r*;^^^ 

2 oo^Ri^lf-ia'jfci lilted -arT. (im^) 
[0013] SI ooimih^X'hh . s i o i tis 

V^T. b'x:t*;<72 0 0^I5Ils»l^tf"C^i: LT, Mi. 
(f#-Cmfh*(^t;[Hl!iE§-l^. ljf*<0«^B«^t'T 
:tr-TtliB§ -fr^C 0 . br :t A*^lg 2 0 2^^1. 
T3ytfjt.-:J'2 0 3O2i5dfi1i^g2 1 0lC7Wi>> 
#ffi<??7r-f/l^^T'tB!i$-(i:S. S l 0 2{C*3l^T, 

^^f3, b'T:tT-TtciiiB$nt:»r>i.Ji-^j4. mm^ 

titzmm 1 7l/-i.-f oJt«6^ J: a ^3 y ha~;u^ 
ffo-C. 7b-i.B«^b'T:tA:'3^a2 0 2 5:^L-C 

^^02O5^:K•9a^■c^!^la^^f5. i^c2i):i£iig 

12 1 0tc(4B«*n 7^-A-f07r-<^UJ^t'iE1i 
§nTl.^ScOT% 2JJ^ie't!^«2 1 0>&>feBm7r-^;P 
SrS?;?i^jitJi:V^O JgT'7U— ABfilS'.X^ U 2 0 5 

yg7i/-AHm&Jt«S7^-AHmtv^3^hiiL, m 

4S-:>Tlr^'i.ifc«7W-ABm^. nSac0^7V- 
AB« (n = 0, 1, N-1 ) fth. SI 03t 
tJV . ^ ^ 2 0 5 7 U-J^mm^ n 

= 0 (-5^ Ol7^-Ag(7)H^) -cS.|,*>i:-p7!,>$:fl 
Bf-tS. n = Ocom^. :trT -^*/^7^-5:S:tiJ•tS 
}t i6£0«^ 1 5: S 7 1/ - AH«*5flii 1 ^c7)T\ 
n = 0 C0jt«7 W'-A®fg^«^7 k-AB^t L . n 
= 1#@C07V-ABMS:SJK^^ l> 2 0 SfclXiJii 

^«7lx-AB«$riif>/i4^TJtSS7l/— ABmt 
•ri,. n=0f^V^t|:»4. fCt=a2^7U— ABm 
(frtCX^ 'J 2 0 SCcKOaAJt'Bffi) *^#4LTV^ 

[00 14] m3ii^fyf:f;:><y(^M^timt<r)m 

^^mmx'ht. ^:iX'yu~M.mmi)'(>^'oiiiLi 

ffp/c46t7)B<S+'D*»^>^SfflX{i:SSffic^x'J yht 

T^;*^7<7)IIISEit^SSrL (m) XrU'^li-ri.lS^B 
B<7)SB^2e (m) . A ^y(r>^'^^'k2 d fth 
trd^^d) \,Z7r:ti:^^Mm^m±o, 

- ( 1 ) 
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[00151 ll4«iiifflfc;^'J -y V<r>^m.h<rmm:M 

X : w/ 2=tan^: tan ( 

<j:^ (3) ^f/^i^i**. mm^'bt-t^x^) 

x= { (w/2) Xtan^} / 
mVii. L = 0. 1 7 (m) . e=0. 03 (m) ii-f 
l>i:. (9=10. 1 6 (de g) ii^rOs ^^t'. w= 
320 (t^-fe/P) . f ovx=31 (deg) tfS 
x = 103 (h-^^-byU) t:^l>. Dt/tf^oT^li^M 

-etil OStrJ'-fe/Pglfi/^iiSA^ SSMat^tgfflcT):^ 
'J ■/ b mm:m O tfl-r/ei^«0S¥*8t ^SrS . 
[00 16] S104t#jV^T. n#B(7)»l7^-A 
B^t n + lSa«JtlS7V-i»HfiSi:oracO;trT'f 

I V I = I (c-a. d-b) I 

[0018] \^-hm^<n-^ 
^tmi>z^j:i. fzfdb. ^;-c:trf•^*;^7P- 

i^^t ^^-fi^-^tzmmiiZMtXii. ^S<^EPfc L-T UiO 
[00 19] ll6{i::t7-7"-f>;l^7D-<?3i^aj*Smt;^. 

'j-/hBmoijBBia-ej).i.. 06 (a) aimwi-chh 
mmyi^~~mmx$)i. me (b) ji^rT^;&;i'7 

D-c^^tBSmT*!.. lae (b) C0:trx'f 

;i?;U7n-o:^tiifeaJi. 06 (a) 0:^TWB*t-0 
V'>Ttf*)ilTl->&. 06 (c ) ^7^-AB®A> 
^>«>9aiL5-fir->^:;^U-yhB®T-2RI.. S105tt> 

T. Sits^W-ixBrn^^^j:^ 'J -y h^^tWOliiL^ff 
l\ XiJ >y hB«2r4^S. 2|s:^<7)f^^tfeV^T 
{4. h'T:t;*^7 2 0 0{4RB^IlI'9tlHlSU. ^rf- 



T^;<?^ 7i07K¥ffiHftS- f o V xJKt i. i: . 

( 2 ) ^zjp-ti: d ^j:mmm 0 i;-^, 

ovx/2) -(2) 

•yhtTiosESix (b•^'-b/^) 

an (f ovx/2) - (3) 

[00 17] 05{47"o-y^'V-yf->':/tj;S:trT^ 
@c7)SJp7^-AB^A»A>*&*P (a, b) 

■*"C^^Q?:PiOMJSji^tf -^t 0 n#Bco«i7l^ 
-AH^iCfctt'S 7*0 .y :?B® B p (O'^'tMmP ( a , 
b ) t\ n + l#atf07^-AHflltfcV-»T Q ( c , 
d) lz:^mLt:t\,^d Ztl,z^^ . -?-<7)^0:r7-T-'f;* 
/P7a-{±, V (c-a, d-b) b\^oK-^h}\^Z'm 

sqrt { (c-a) 2 + (d-b) 2 ) 

... (4) 

^^coi^miiEBmRr/^sm<r>^ti^H.(nx y >y 

hBSiW«Jp«IWffl^3{,»^,£i!l£7)95iJ-t« t-CSSp7 u 
-ABfil*»^>^OIRS (<IOi|g^XU>yhHII«0lgWt 

-rs) . 

[002 0] ::c:T't'T^;ir;<7 2 0 0{i. 

si:<oiiiefflt;MLTiiie-r&i6^ la^xtv^^v^co 
x\ m^yu-Ammtimyu-Ammtiimi-fi 

TT4^)i^y^-<omm]S.miot^^. ifii)<-^x^ 
rT^t)\^yu-<r)izf^itAiW-^^(r)?)^^mmv. m 
^&zti,zi-^, 

[ 0 0 2 1 ] 07 {iT. U -y hlimoM-^Srtf 0 0T'*) 

S106tfc>^T. n#@i7)^7W-AB^3&^^, 
WOai^il/t;^'^ -y hBfiSI:. n - iSa^T'CDX'J 

^^-rs. i^f. xuyhB^^fe^-rsesi. 

^rr-f;«r/l'7D-<o*^F«^«4f^\I-C*>fi{i\ t' 
•TJf;<?^72 0 oa^EtcniteLTV^sc: tC^l.cOT\ 
:^'J'y ^BmS:^^V7^B«{^MLT£^g!t^^■^L. fr 

fc5:AV7-?B«5-4^-r&. mz'^mThfiit. 

'yhB«(±^V7VBmt»LT*«t»-&L. Wz^j: 
f<yy-^mm^E^^. io^ratitW;4f^7 2 0 

OcOIaIK:fr[6]tfic#LTV^I,<7)T\ :tBfflcOv\V7-7B 




[00 2 2] SI 07(^^>V^■C. § ^.{Cfe^f S<5J«7 

( 0 n = N - 1 x'^ifti\i£ ) . m&(^Mty u— A 
mmm:yu-j>-mm lts i o i i,zt5^^xmz^j: 

■tt<!K.eoyv-j:.mm¥^L-^j:i-nnt (-oi 0 n =N 

[0023] ia8{i»it#«IIAiOiKHB0T'S)S. 08 
( a ) ttmR±TgEM'0S^r^:ty>'x:5' hARX/B 

vm.'th}^. 6'(SftE|5SiSio^ryvx^' ht*ft--s.i?^f 
y i;=x ^ b B ^iEiS^:gei®t'XxW:t«-C# S j: d 

■r&JtJ^tCJi. >ryi^'x^'hA^:tyi^x^bBCO» 

T\ siosttev^T. AV7VH^i^c7)#7j-:/i^x^' 

[0 0 24] US (b) W^Jv-^mWHniifV:!.^ 

vm'^tm.n^Lmmm-'mhh, eis (b) 

(^^-fiofc, O' D' tZE" O" F' 5:S1 

0 4-(:'i:tijL:^c2 6'{c-gc$-^|.i:, 0. 6' m/0" 
(O^cr)m^l,id>0' >0" t^rS. o^f), 

a=rsin^' /sin — 
tan^' = sin 6/ ( c o s (9 
CiCDfiS:^ V7VHfil^o^:t:7'i^'x^ h (citfBWtTte 

[ 0 0 2 7 ] ^tJ , ^ri^'a: ^ V S T'COSElfficOSJg^rffi 

'^oXdizmj^^mMcomm^ff^\ ztL(yff)vyr 

[0 0 28] m 0{i. S 1 09^C;^o^t■i»'^V5vB# 
o-f-x'- b-Cfcl. . S 1 0 9 ttSV^ 
T. *1t^MM^|fc^-:3fV>T. S1001~S1007 
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Amiz]5:<^j:hn. mi^^MAli±^<^j:?>, Lfz 
*^oT, :t7'>''x^hA' tfali. 5j-7Vx:?hB' ^ 

[0025] H9{ij|^f#^III:ft^^S-:^v■>5ty^v 7-7a 

t-rs. :iivmbLx. s' ^it/fT' tieiiSixTv^ 

?.3r7Vx^'h*>T28 (b) <?):t7'>-'x^hA' T-J.^ 

J: 0 ^rri/'x h A ■ f}<iEm^j:{mizmm^tix 

■^fzZt iZ^j: 0 . i^'x ^ h A*<jE«^{aB{cKa$ 
[0 02 6] <iCfc5j-yi^'x:?htT-i7)ffiili:, ll^f^« 

m^b(r>m^^^^. ma (h) t,zm^x. nitew*-^ 

:t7'i>"x^'bA' tX'(r)m^A' O' =a. [11®^ 

O' A' ) 2r<9. :t:ri^*x:J'hA' t35trS®fi^^ 
:ftZG' C A' =0' fc-r&fc. iJi:^ ( 5 ) JilA' 

8) -(5) 

-r/a) -(6) 

^^^^'t'WclIlKS-frT^JfliBl'ti,. SI 000 
tCfcV^T. ^WkWiVxt^, S 1 0 0 1 {Zii\\X. 

hizm]i^tLrzm7^^mMizm-:5\^x-&B 

s 1 0 0 2 tcjDV>Ts :£affl«7NV ^-eaei^TT ^ 
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